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FOREWORD 

Time-optimal  beam  steering  requires  a  type  of  control  that  is  much 
different  than  conventional  methods.  The  typical  controller  design  is  one 
in  which  states  of  the  system  are  fed  back  against  some  incoming  control 
signal  designed  to  control  a  certain  state.  The  design  of  the  controller 
centers  on  the  method  of  feedback  and  usually  some  pole  placement  technique 
which  makes  the  system  assume  the  desired  characteristics.  But  time-optimal 
control  is  concerned  with  neither  pole  placement  nor  method  of  feedback. 
Time-optimal  control  is  concerned  solely  with  designing  the  input  control 
signal  to  make  the  system  attain  a  desired  end  condition  in  the  fastest 
possible  time.  The  only  design  criterion  is  time,  and  the  only  part  of  the 
system  affected  is  the  input. 

The  form  of  time-optimal  control  postulated  in  this  series  is  bang-bang. 
The  bang-bang  waveform  switches  between  the  maximum  and  minimum  control  values 
with  precisely  the  right  frequency  and  duration  to  bring  the  system's  model 
from  its  initial  condition  to  a  desired  end  condition. 

Time-optimal  control  is  an  open-loop  method  of  control,  because  the 
control  waveform  is  calculated  from  a  priori  boundary  conditions  and  does 
not  require  adaptation  during  the  exercise  of  the  control.  Nevertheless,  it 
can  be  used  on  a  closed-looD  system  because  it  is  performed  and  calculated 
independently  of  the  system's  controller.  The  time-optimal  control  is  cal¬ 
culated  by  modeling  the  closed-loop  system  in  the  time-domain  and  then  solving 
a  boundary-value  problem  for  the  entire  system,  including  the  control. 

Time-optimal  control  offers  an  advantage  for  speed  of  retargeting  and 
stabilization  over  conventional  methods  of  input.  In  fact,  the  more  rigorous 
the  settling  criteria,  the  better  time-optimal  control  performs,  because  it 
is  solved  for  boundary  conditions  (initial  condition  and  final  desired  con¬ 
dition).  It  provides  the  fastest  movement  from  one  state  to  another  to 
whatever  degree  of  accuracy  the  model's  parameters  allow.  On  the  other  hand, 
classical  control  simply  uses  a  constant  input  for  retargeting  and  lets  the 
system's  dynamics  cancel  the  error  at  the  characteristic  rate  of  the  system. 
Because  of  this,  accurate  settling  criteria  take  a  great  deal  of  time  to 

i  i  i 


achieve  classically,  whereas *the  time  needed  to  retarget  optimally  is 
relatively  Insensitive  to  accuracy  requirements. 

The  time-optimal  problem  can  be  solved  for  any  system  that  can  be  modeled 
in  the  time  domain.  The  solution  for  a  beam  steering  problem  typically  can 
be  guessed  at,  in  general,  to  require  n-1  switchings  between  maximum  and 
minimum  command  values,  where  n  Is  the  system  order.  This  seems  to  hold 
true  for  small  displacement  steerings  from  zero  initial  conditions,  a  prob¬ 
lem  consistent  with  optical  retargeting.  This  boundary- value  problem  can  be 
solved  for  any  size  system  by  reducing  the  order  of  the  model  and  gradually 
building  up  to  the  full-order  model  and  exact  solution  by  using  solutions 
obtained  from  the  simpler  lower-order  models. 
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I.  OVERVIEW 


This  report  in  the  Time-Optimal  Adaptive  Shaped  Torque  (TOAST)  effort  was 
originally  five  separate  papers,  written  over  2  years,  describing  the  progres¬ 
sive  breakthroughs  in  the  understanding  of  the  time-optimal  bang-bang  problem. 
At  first,  very  little  was  known  about  any  method  of  solving  time-optimal  prob¬ 
lems.  At  first,  simple  second-order  problems  were  solved.  The  major  turning 
point  for  understanding  of  the  bang-bang  problem  was  the  discovery  of  a  gen¬ 
eral  method  of  solution  that  works  for  large-order  models  with  complex  eugen- 
values.  From  there,  some  general  conclusions  were  made  about  time-optimal 
enhancement.  Finally,  time-optimal  problems  were  solved  for  a  9th  order  beam 
steering  mirror  (BSM)  model. 

Section  II  was  the  first  TOAST  article  written.  It  outlines  the  common 
variational  calculus  for  the  time-optimality  of  the  bang-bang  waveform.  It 
also  describes  the  graphical  switching  curve  method  for  solving  simple  second- 
order  tracker  (nonzero  end  condition)  problems.  The  methods  of  solution  here 
are  good  only  for  second  order  problems.  Nevertheless,  they  are  a  step  in 
understanding  bang-bang  theory. 

Section  III  explains  how  the  time-optimal  control  can  be  used  with  a  closed 
loop  system  and  why  it  is  desirable  to  do  so.  It  begins  with  a  derivation  to 
show  why  maximum  commands  yield  such  an  improvement  in  retargeting  speed.  It 
then  gives  some  simple  second-order  examples,  comparing  time-optimal  effects 
on  closed-  and  open- loop  systems. 

Section  IV  is  an  adaptation  from  the  most  critical  article  of  the  entire 
TOAST  series.  This  paper  (presented  at  the  1986  American  Control  Conference 
in  Seattle  in  June  1986)  derives  the  general  solution  of  the  bang-bang  bound¬ 
ary  value  problem  for  nth  order  systems  with  complex  eigenvalues.  On  this 
algorithm,  the  time-optimal  solver  code,  SYS,  is  based.  This  section  explains 
the  algorithm  and  gives  a  simple  third-order  example. 

Section  V  quantitati vely  describes  the  enhancement  of  a  Type  II  control¬ 
ler  using  time-optimal  techniques.  It  shows  how  the  effective  retargeting 


bandwidth  of  a  system  is  improved  with  time-optimal  control  and  that  this 
enhancement  becomes  more  dramatic  as  the  settling  requirements  for  the  system 
become  more  rigorous.  This  section  also  details  the  canonical  time-domain 
form  for  a  system  model  and  the  time  and  magnitude  scaling  that  are  essential 
to  successfully  using  the  SYS  algorithm. 

Section  VI  describes  the  solution  of  time-optimal  problems  for  the  91-*1- 
order  model  of  an  actual  BSM  in  the  laboratory.  It  begins  by  describing  the 
gth_0rder  transfer  function  for  position  versus  control  input.  It  then 
explains  the  time-domain  modeling  of  the  system  along  with  the  necessary  scal¬ 
ing  approaches.  Then,  it  details  a  method  of  solving  large-order  problems 
through  reduction  of  order  and  gradual  rebuilding  to  an  exact  solution  for  a 
full-state  model.  Most  importantly,  it  introduces  the  apparent  one-for-one 
relationship  between  system  eigenvalues  and  the  associated  time  legs  of  the 
exact  time-optimal  control  solution.  The  report  concludes  with  a  discussion 
of  the  performance  of  lower-order  models,  arguing  that  the  advantages  to  time- 
optimal  control  may  be  obtained  by  simply  solving  for  reduced-order  models 
that  account  for  the  system's  critical  eigenvalues  instead  of  the  more  compli¬ 
cated  full -order  models. 
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II.  TRACKER  FORMULATION  OF  THE  BANG-BANG  PROBLEM 

TIME-OPTIMALITY  OF  THE  BANG-BANG  TECHNIQUE 

Using  Hamiltonian  analysis  and  the  maximum  principle,  we  will  demonstrate 
the  time-optimality  of  the  bang-bang  approach.  We  begin  with  a  system  for 
which  the  dynamics  and  control  are  described  as 

x  »  Ax  +  bu  (1) 


where  A  is  the  dynamics  matrix,  b  is  the  input  vector  and  u  is  the  scaler 
control.  The  control  variable  u,  for  most  physical  systems,  is  constrained  to 
some  maximum  amplitude.  For  instance,  if  u  describes  an  input  torque,  there 
is  a  maximum  limit  to  the  magnitude  of  the  torque  in  either  positive  or  nega¬ 
tive  sense.  So  we  have  limits  on  u,  a  and  a  ,  such  that  <_  u  <_  a2. 


To  invoke  variational  methods,  the  time-optimal  cost  function  is  defined, 
which  in  its  Lagrange  form  for  an  unspecified  time  problem  is 


=  /  *(x,x, 

J  t. 


t)  dt 


For  the  time-optimal  problem,  $ 
Lagrange  multipliers,  we  have 


=  1  or  >J  =  T,  - 


(2) 


tQ.  Using  the  method  of 


*  j  +  xT(Ax  +  bu  -  x)j 


dt 


(3) 


Defining  the  Hamiltonian  H  =  1  +X^(Ax  +  bu)  (Ref.  2),  we  then  have 


tf  r 

-  f  H  -  fx  dt 

A  L 


(4) 


Taking  the  variation  of  J  and  setting  it  to  zero,  we  have  • 


6J 


dt  =  0 


(b) 


After  integration  by  parts. 


J  =  -xA^ 


(6) 


From  this  the  canonical  equations  are 


(7) 


Because  nothing  is  known  about  A,  these  equations  are  not  helpful  in  deter¬ 
mining  an  optimum  u  except  for  the  fact  that  the  Hamiltonian  must  be  minimized 
with  respect  to  u.  Because  H  =  1  +  aT  (Ax  +  bu),  it  is  clear  that  H  is  mini¬ 
mized  for  a^  ^  u  j<  a2  when 


u  =  for  A^b  >  0 
u  =  a^  for  A^b  <  0 


(8) 


and  thus  this  defines  the  optimal  control. 

i 

The  variable  A,  called  the  influence  function,  is  useful  for  some  bang- 
bang  problems.  From  Equation  7,  we  know  that  A  =  -A  A,  hence,  the  influence 
function  is  characterized  by  the  same  dynamics  as  the  uncontrolled  x.  An 
expression  for  a  can  be  determined  in  terms  of  a  at  the  final  state.  As  will 
be  seen,  u  is  an  explicit  function  of  a  and  so  the  control  law  may  be  expressed 
in  terms  of  a  final  condition  for  a.  This  relationship  is  useful  for  finding 
the  set  of  possible  initial  conditions  given  a  time  interval  for  the  problem 
(Ref.  1).  However,  for  these  purposes  we  have  known  initial  conditions. 


therefore,  x  is  not  a  useful  variable  to  determine.  In  the  second-order  case, 
it  is  necessary  only  to  know  the  system  dynamics  and  the  boundary  conditions  to 
do  the  problem. 


THE  BANG-BANG  REGULATOR 

We  can  now  specify  the  time-optimal  or  bang-bang  control  for  a  regulator 
constraining  u  to  be  |  u|  <_  1  and  thus,  u  =  -sign  .  For  the  two- 

dimensional  problem,  (i.e.,  one  in  which  only  two  states  are  defined)  the 
bang-bang  problem  can  be  solved  graphically  by  the  use  of  a  switching  curve. 

To  determine  the  switching  curve,  it  is  necessary  to  integrate  backwards  in 
time  from  the  origin.  If  we  fine  the  switching  curve  state  as  if,  we  have 

l  -  -Af  -  6uf  (9) 

where  u^  is  the  final  control  value  which  will  be  used  to  drive  the  state 
to  zero.  Shown  in  Fig.  1  is  a  switching  curve,  in  phase-space  (xl  -  x2), 
for  the  problem: 

**n  o]*+[oiu  <io) 

In  the  second-order  case,  the  final  control  value  is  the  second  control  value 

used.  Figure  2  shows  the  time-optimal  trajectory  given  an  initial  condition 

T  IT  ' 

of  2  -1 

Once  the  switching  curve  is  drawn  in  two  dimensions,  one  only  has  to  pro¬ 
pagate  the  system  forward  in  time,  from  any  initial  condition,  with  a  value 
for  u  which  will  impel  the  state  toward  the  switching  curve.  When  the  state 
intercepts  the  switching  curve,  the  value  of  the  control  is  switched  to  the 
value  of  the  opposite  sign,  causing  the  system  to  follow  the  switching  curve 
to  the  origin.  If  this  procedure  is  followed  as  demonstrated  in  Fig.  2,  the 
result  is  the  optimum  switching  law  for  any  second  order  system. 


Figure  1.  Regulator  Switching  Figure  2.  Trajectory  of  Regulator 

Curve.  Example. 

The  time  elapsed  to  the  switching  from  u  «  1  to  u  *  *1  (the  switching 
time)  is  0.693  s,  and  the  time  from  the  switch  to  the  origin  is  0.406  s  for  an 
approximate  total  time  of  1.098  s.  It  is  simple  to  calculate  that  this  same 
dijplacement  for  the  command  input  u  =  0  takes  3.4  s  in  total  time  to  reach 
the  origin  (within  a  tolerance  of  0.1).  We  see  then  that,  to  the  extent  that 
the  maximum  magnitude  of  the  input  commands  are  greater  than  the  input  com¬ 
mands  required  for  the  desired  displacement,  the  bang-bang  technique  has  a 
dramatic  effect  in  terms  of  time-optimality. 

i 

Larger  order  systems  can  be  regulated  using  more  switchings.  It  has  been 
shown  that  an  nth-order  system  with  real  poles  can  be  brought  to  a  zero  state 
in  the  shortest  time  using  the  bang-bang  method  with  a  maximum  of  n-1 
switchings  (Ref.  2).  The  switching  curve,  however,  is  only  good  for  indi¬ 
cating  the  final  switch.  Calculation  of  the  input  bang-bang  profile  for 
systems  of  order  larger  than  2  must  be  done  by  diagonalizing  the  system  with  a 
linear  transformation  and  representing  the  intersection  of  the  switching 
hypersurfaces  with  a  series  of  n  nonlinear  equations  (Ref.  3).  The  solution 
of  this  problem  will  be  detailed  in  Section  IV. 


THE  BANG-BANG  TRACKER 


For  purposes  related  to  space  systems  that  require  a  fast,  accurate 
displacement  with  no  ringing,  the  tracker  formulation  of  the  bang-bang  problem 
is  necessary.  Rather  than  reducing  the  state  x  to  zero,  we  wish  to  bring  the 
state  x  to  some  target  set  of  conditions  xQ.  We  can  define  the  error  of  state 
x  to  be  y  =  x  -  xQ.  We  then  have: 

y  =  x 

x  *  Ax  +  bu 
? =  'xo +  * 

y  =  Ay  +  Axq  +  bu  (11) 

The  solution  to  this  problem  follows  the  same  course  as  the  solution  for  the 
tracker  except  that  now  the  equation  for  the  switching  curve  is 

\  -  -AC  -  Axq  -  bUf  (12) 


The  switching  originates  from  the  origin  because  £  is  a  variable  of  y-space, 
and  we  wish  to  bring  the  error  to  zero.  To  construct  the  switching  curve  in 
x-space,  the  transformation  x  =  \  +  xQ  is  used.  As  a  result  of  this  trans¬ 
formation,  the  x-space  switching  curve  originates  from  xq  and  is  symmetric 
about  this  point  as  shown  below  in  Fig.  3  for  which  the  target  set  is 
x. 


|o  0.25  T. 


The  problem  is  solved  in  the  same  manner  as  the  regulator.  An  initial 


condition  is  chosen,  in  this  case, 
this  initial  condition  until  the  sw 


o  o]T. 


The  system  is  then  propagated  from 


tching  curve  is  struck.  A  switch  in  the 


control  is  then  mandated  and  the  states  are  brought  to  the  desired  condition. 


For  this  problem,  the  switching  time  is  1.171  s,  and  0.119  s  elapse  from 
the  switching  point  to  the  origin  for  a  total  of  1.290  s.  Using  the  input 
command  u  -  0.5  to  bring  the  system  to  the  desired  state  requires  over  3.5  s 
(for  a  5  percent  settling  time).  Again,  the  bang-bang  method  renders  a  con¬ 
siderable  time  savings. 


Figure  3.  Tracker  Switching  Curve.  Figure  4.  Trajectory  of  Tracker 

Example. 

CONCLUSION 

The  bang-bang  problem  for  a  second-order  system  (with  real  poles)  is  a 
relatively  simple  one  which  can  be  solved  graphically  using  the  technique  of 
the  switching  curve.  The  bang-bang  approach  renders  the  time-optima)  solution 
to  any  problem  for  which  the  maximum  control  value  is  greater  than  that 
required  to  command  the  system  to  a  target  state  by  conventional  means.  This 
method  provides  a  substantive  savings  in  time. 
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III.  BANG-BANG  CONTROL  OF  CLOSED-LOOP  VERSUS  OPEN-LOOP  SYSTEMS 
MOTIVATION 

The  option  of  controlling  a  closed  or  open  loop  is  a  critical  issue  in 
the  use  of  bang-bang  control  for  BSMs.  The  time  resoonse  of  a  closed-loop 
system  is  highly  dependent  on  the  value  of  the  innut.  The  attractiveness  of 
the  bang-bang  approach  to  control  hinges  on  the  fact  that  the  fastest  way  to 
make  a  system  respond  is  to  give  it  maximum  commands  as  opposed  to  giving  it 
the  desired  value  for  the  state  as  the  input  and  waiting  for  the  system  dyna¬ 
mics  to  eliminate  the  error.  The  bang-bang  technique  will  always  work  faster 
as  long  as  the  maximum  inputs  are  of  larger  magnitude  than  those  used  to  com¬ 
mand  the  system  to  attain  a  state  in  the  classical  way.  This  is  true  for 
closed-loop  and  open-loop  systems. 

We  can  examine  a  simple  second-order  system  and  close  the  loop  with  unity 
feedback :  u  x(t) 


(s+p»)(s+p2) 


This  system  simplifies  easily  to 


1+G 


S2  +  (p,  +  p2)s  +  (p,p2  +  1) 


If  the  system  has  a  complex  conjugate  pair  for  its  poles,  then  we  have  the 
familiar  representation: 


s*  +  2(cjns  + 


where  c  is  the  damping  and  is  the  natural  frequency.  In  state  space: 


‘2<wn  "Wn  -  ' 
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where  u  =  u>n2r,  x2  =  x,  and  xx  =  x2  =  x. 


We  can  go  back  to  the  differential  equation  in  x(t)  for  this  closed-loop  sys¬ 
tem  and  solve  it  in  time.  By  inspection  of  the  block  diagram: 

-12-2 

x  +  2tu>nx  +  ton  x  =  ra>n  (14) 

Now  if  r  is  a  constant  (which  it  is  for  this  purpose),  then: 

x(t)  =  CleXlt  +  c2eXzt  +  r  (lb) 


where 


*i.2  -  -twn  -  wn  /  -  1  or  -tuin  +  iu)n  /  1  -  cz  (l*>i 

The  eigenvalues  (x^  )  are  dependent  solely  on  the  characteristics  of  the 
system.  However,  solving  for  c2,  and  c2  given  initial  condition  xQ  and  xQ, 
we  have: 


Ci  +  c2 


xo  -  r 
(xQ  -  r)X2 

X  ?  -  Xi 


XiCi  +  x2c2  =  XQ 

x0  +  Xi(r  -  x0) 

c2  =  - 

X i  -  x2 


Hence, 


r x  —  x  x2  .  ,  x  x i  “  x  .  .  r,  Xit  ,  ^  _ x2t 

.(t)  =l  °  °  e*it  +  —2 _ 2.  4  * 2 e  J  *ie 


e“  + 


2(un/!;  -  1 


2„n^l 


►  1  r  (18) 


2U„^T 


Now  we  have  found  conclusively  that  the  time  response  for  a  general  second- 
order  closed-loop  system  is  directly  related  to  the  value  of  the  input  value 
r--that  not  only  is  the  steady-state  value  of  the  response  changed,  but  also 
the  transient  response  is  changed. 
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Furthennore,  if  the  initial  conditions  are  xQ  *  xQ  *  0,  as  they  typi¬ 
cally  are  for  this  purpose, 

x(t)  «  ^1  -  ■  Jcsin  (un/l  -  cf)t  +  /I  -  czcos(u>nA  -  c7” ) tj^r  (19) 

which  is,  of  course,  directly  proportional  to  r.  If  we  make  the  assumption 
that  the  state  will  settle  at  a  time  close  to  zero  (good  for  this  purpose),  we 


-Cu)  t 

x  (t)  '  [1-e  "  ]  r 


If  rise  time,  tf,  is  defined  as  the  time  it  takes  for  the  system  to  go  from 
0.1  to  0.9  of  the  desired  steady-state  value  (Ref.  4),  we  see  that  the  rise 
time  is  dependent  both  on  the  system's  poles  and  the  input  r.  If  a  higher 
input  r  is  used,  the  closed-loop  system  will  move  toward  the  target  more 
quickly.  From  this  intuitive  argument,  it  can  be  seen  that  the  time-optimal 
approach  to  attaining  the  desired  steady-state  value  is  to  use  maximum  inputs 
(bang-bang).  For  example,  assume  that  the  maximum  possible  input  for  r  is 
2.0,  and  desired  steady-state  value  for  x  is  1.0.  Using  the  conventional 
method,  we  would  input  r  *  1  so  that 

-S«*  t 

x(t)  =  1-e  n  (21) 

Because  rise  time,  tp,  is  defined  as  the  time  it  takes  to  get  from  x  =  0.1  to 
x  *  0.9,  define  tx  as  the  time  it  takes  to  get  from  x  =  0  to  x  ■  0.1  and  t2  as 
the  time  it  takes  to  attain  x  ■  0.9.  We  have 


'SV1 


=  0.1  =>  -c<ontx  =  ln(0.9)  «>  tx  =  7^- 

’  n 


1-e  n  =  0.9  =>  -tu)nt2  =  1n(0.1)  =>  t2  = 

t  . t  . .  .  hi 
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If,  however,  r  =  2  then 


x ( t)  +  2-2e  n 


1-e 


0.05  =>  ti 


0.0513 


1-e 


-^nt2 


0.45  =>  t2  =  (23) 

g  n 


and 


-  0-55 
cw„ 


which  is  one-fourth  of  the  rise  time  for  the  input  of  r  =  1.  Hence,  the  use 
of  maximum  inputs  has  a  great  effect  on  the  speed  of  the  closed-loop  system's 
reaction  and  it  will  be  seen  in  the  examples  that  the  bang-bang  technique  will 
have  a  dramatic  effect  on  the  response  for  both  closed-loop  and  open-loop 
systems . 


EXAMPLE  1:  CLOSED-LOOP  SYSTEM 


Because  the  purpose  of  this  section  is  to  demonstrate  bang-bang  perfor¬ 
mances  for  a  system  given  different  conditions,  only  results  will  be  given. 

To  define  a  regulator  problem,  consider  a  real-pole  system  with  a  closed-loop 
characteristic  equation  s2  +  3s  +  2.  If  this  is  a  closed-loop  system  with 
unity  feedback,  the  closed-loop  poles  are  =  -1,  and  x2  *  -2,  and  the  open- 
loop  poles  are  Pi  =  -0.3820  and  p2  =  -2.618.  Thus,  the  closed-loop  system  is 
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J  _  T 

where  |u |  _<  1  and  the  target  conditions  is  x  =  [0  0]  .  If  we  define  the  ini¬ 

tial  condition  as  xQ  =  [2  -l]T,  then  the  time-optimal  control  is 


u  =  1  0  <  t  <  0.693 


u  =  -1  0.693  <  t  <  1.098 


(25) 


Hence,  in  approximately  1.098  s  the  system  is  brought  to  zero  as  shown  in 
Fig.  5. 


Figure  5.  Time-Optimal  Time  Response  of  Example  1. 


The  break  point  in  the  trajectory  shows  where  the  control  switch  was  made.  If 
we  were  to  use  the  conventional  command  input  technique  (which  uses  the 
system's  natural  dynamics  to  reduce  the  error)  then  we  would  input  u  -  0  as 
shown  in  Fig.  6. 


TMC  ’ 

Figure  6.  Time  Response  of  Example  1  with  Input  Command  u  *  0. 

As  the  graph  shows,  such  a  method  takes  over  3  s  to  bring  the  states  close  to 
zero.  Hence,  the  bang-bang  technique  is  dramatically  faster  than  the  desired 
state  input  command  for  a  closed-loop  system. 


EXAMPLE  2.  OPEN-.LOOP  SYSTEM 


As  stated,  the  open-loop  poles  are  at  -0.382  and  -2.618.  For  the  open- 
loop  problem,  we  break  the  loop  on  the  system  and  input  the  control  directly 
to  the  plant  until  the  state  is  brought  to  zero  (or  nearly  to  zero),  and  then 
the  loop  is  closed  again. 

Since  the  same  input,  u  =  +  1,  will  be  used,  we  should  expect  the  bang- 
bang  performance  of  the  open  loop  to  be  slower  than  the  closed  loop  because 
the  dominant  pole  is  closer  to  the  origin  in  the  s-plane.  This  is,  in  fact, 
the  result  which  we  find.  The  time-optimal  control  profile  is 

u  *  1  0  <  t  <_  0.916 

u  =  -1  0.916  <  t  <  1.233  (26) 

Now  the  total  time  required  is  1.233  s  as  opposed  to  1.098  s.  The  time 
response  appears  below  in  Fig.  7: 


TIME  < 

Figure  7.  Time  Response  of  Example  2. 


The  time  required  to  reach  the  origin  if  the  input  command  u  =  0  is  used 
requires  over  30  s,  which,  of  course,  is  much  greater  than  the  bang-bang 
requirement. 
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EXAMPLE  3.  A  MORE  REALISTIC  CLOSED-LOOP  SYSTEM 


In  a  true  closed-loop  system,  one  does  not  directly  input  a  torque  to 
the  plant  and  attempt  to  use  that  as  a  control,  but  more  often  will  input  a 
reference  command,  which  acts  on  some  compensation  to  provide  a  torque  which 
will  drive  the  system.  The  diagram  below  shows  this  configuration,  which 
resembles  compensation  on  existing  BSMs  (Ref.  5). 


COMP  = 


This  can  be  simplified  to 


GC 

x(t) 

G(C+1)+1 

Transfer 

Function 


s+a 

(s+p,)(s+p2)(s+b)  +  2s+a+b 


For  the  open-loop  system  of  example  2  and  a  compensator  C  =  s+l/s+4.  we  have 


s2  +  6s  +  9 
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Now  we  can  do  this  problem  for  the  compensated  system.  However,  we  must 
determine  limits  for  r.  We  know  that  |uj  £  1.  Also,  at  low  frequencies 
the  compensator  gain  is  a/b  or  1/4.  Assuming  small  departures  from  the 
origin,  then  |r|  £  4.  We  can  now  solve  the  bang-bang  problem  for  r  =  ±  4. 


Figure  8.  Time  Response  of  Example  3. 

Figure  8  shows  the  time  response  for  this  example.  The  switch  from  u  =  4  to 
t  =  -4  is  made  at  approximately  0.548  s  and  the  state  reaches  the  origin 
after  a  total  of  0.718  s,  which  is  a  shorter  time  than  required  by  the  uncom¬ 
pensated  closed  loop.  We  should  expect  this  because  the  effect  of  the  compen¬ 
sation  is  to  drive  the  s-plane  poles  to  faster  locations. 

EXAMPLE  4.  A  REALISTIC  OPEN-LOOP  SYSTEM 

The  system  of  Example  3  may  be  controlled  in  an  open  loop.  The  system 
would  be  represented  as 


or  in  block-diagram  form 


s2  +  6s  +  8 
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which  in  state-space  form  is 


;  ■  n  •  ] ;  *  [  j  ] '  <2 

Again,  the  input  used  is  r  =  ±  4.  The  result,  shown  in  Fig.  9  is  that  the 
switch  occurs  at  0.585  s  and  takes  a  total  time  of  0.746  s  to  reach  the 
origin. 


TIME 

Figure  9.  Time  Response  of  Example  4. 

As  expected,  this  result  is  just  slightly  slower  than  the  closed  loop,  but 
is  much  faster  than  the  uncompensated  open-loop  and  closed-loop  examples. 

REAL  WORLD  CONSIDERATIONS 

The  examples  shown  are,  of  course,  much  simpler  than  the  systems  that 
are  encountered  when  considering  actual  BSMs.  The  System  dynamics  for  a  BSM 
alone  can  be  modeled  as  a  fourth-order  or  sixth-order  system.  Accounting 
for  the  entire  control  system  can  make  the  model  a  tenth  or  higher  order 
problem.  Hence,  the  computation  involved  for  the  method  of  Examples  3  and  4 
can  be  prohibitive1,  particularly  in  a  system  where  the  computation  is  real¬ 
time.  Additionally,  the  closed-loop  will  invoke  more  orders  if  the  feedback 
loop  is  something  other  than  mere  oroportional  control.  However,  the  closed- 
loop  approach  in  general  should  not  be  much  more  complicated  than  the  open- 
loop  in  terms  of  computation. 
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CONCLUSION 


Closed-loop  bang-bang  control  provides  a  faster  way  of  retargeting  sys¬ 
tems  than  does  open-loop  control.  Although  only  simple  real-pole  examples 
have  been  given  here,  the  results  extend  to  the  higher-order  complex-pole 
case.  Closed-loop  control  takes  advantage  of  inherently  faster  poles  at  a 
low  cost  in  increased  complexity. 


IV.  SOLUTION  OF  THE  BANG-BANG  BOUNDARY  VALUE  PROBLEM  .FOR  Nth-ORDER 

SYSTEMS  WITH  COMPLEX  EIGENVALUES 

MOTIVATION 

Existing  solutions  for  the  bang-bang  control  problem  tend  toward  either 
solutions  to  the  real  eigenvalue  problem  (Ref.  6)  or  very  broad  approaches 
that  produce  bang-bang  solutions  by  a  limiting  process  (Ref.  7).  In  this 
section,  a  specific  solution  will  be  demonstrated  that  assumes  the  bang-bang 
profile  for  the  optimal  control  given  the  maximum  amplitudes  of  the  control 
variable,  a  postulated  number  of  switchings,  and  an  initial  guess  at  the 
control  profile. 

The  bang-bang  boundary  value  problem  attempts  to  take  the  states  of  a 
system  from  an  initial  condition  in  a  desired  final  condition  in  the  shortest 
possible  time.  If  a  solution  exists,  it  uses  only  the  maximum  and  minimum 
values  of  u,  switching  between  the  two  with  a  frequency  and  duration  that  is 
time-optimal.  For  a  system  of  real  eigenvalues,  it  is  well-known  that  the 
optimum  number  of  switchings  is  n-1,  where  n  is  the  order  of  the  system 
(Ref.  8).  For  a  system  of  complex  eigenvalues,  no  such  guarantee  can  be 
made,  but  often  n-1  is  the  optimum  number  of  switchings.  For  a  second-order 
system,  the  optimum  bang-bang  profile  can  be  found  using  switching  curves 
(Ref.  9).  For  a  problem  which  requires  more  than  one  switching,  switching 
curve  analysis  is  inadequate,  and  the  control  profile  must  be  found  compu¬ 
tationally.  This  analysis  can  be  done  by  uncoupling  the  system  and  using 
the  boundaty  conditions  to  fashion  a  series  of  complex  nonlinear  equations 
which,  when  solved  simultaneously,  yield  the  optimum  control.  To  decouple 
the  system,  we  use  a  similarity  transformation  as  follows: 

A  system  whose  dynamics  and  control  are  defined  by 

x  =  A-  +  bu  (28) 

where  x  is  the  state  vector  of  dimension  n,  A  is  an  n  x  n  dynamics  matrix, 
b  is  an  n  sector  and  u  is  a  scalar,  may  be  transformed  by  a  similarity 
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transformation  y  =  P"*x,  where  P  is  a  modal  matrix  of  the  column  eigenvectors 
of  A.  Such  a  transformation  yields  P_1A  P  =A  ,  where  A,  where  A  is  the 
diagonal  matrix  of  the  eigenvalues  of  A.  We  then  have 


y  =  Ay  +  P"1  bu 


In  a  physical  system,  some  of  the  eigenvalues  are  complex  conjugate  pairs 
and  the  remaining  are  real  poles.  Hence,  for  a  system  of  m  complex  conjugate 
pairs,  there  are  n-2m  real  poles.  Because  the  dynamics  matrix  is  diagonal  in 
y-space,  the  form  of  solution  for  each  component  of  y  is  a  simple  exponential 
with  a  constant  particular  solution,  since  u  is  constant  for  the  bang-bang 
problem.  However,  the  solutions  for  states  with  complex  eigenvalues  are 
complex  and,  thus,  yield  two  equations,  one  each  for  the  real  and  imaginary 
parts.  A  transformation  can  be  chosen  which  results  in  duplication  between 
the  conjugate  states  so  that  each  complex  pair  yields  only  two  unique  equa¬ 
tions.  The  result  is  that  a  boundary  value  problem  for  an  n-order  system  of 
complex  poles  may  be  characterized  by  n  equations  in  time,  and  if  a  bang-bang 
solution  exists,  it  may  be  found  exactly  using  these  equations. 

SOLUTION 

From  Equation  29,  each  state  in  y-space  is  described  by  the  equation 
(using  component  notation) 

h  =  <°A  +  l("A^A  +  PAj“lbju  (30) 

where  oA  +  is  the  Ath  eigenvalue  of  the  system,' and  this  has  the  solution 


*A(t)  =  *A0  + 
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Now  for  the  boundary-value  bang-bang  problem,  initial  and  final  conditions 
have  been  fixed,  an  unknown  elapsed  time,  (which  should  be  minimized)  and  an 
unknown  number  of  switchings.  Experience  shows  that  it  is  best  to  guess  that 
there  will  be  n-1  switchings,  although  the  number  of  switchings  cannot  be 
guaranteed  for  the  bang-bang  problem  with  complex  poles  (Ref.  7).  A  minimum 
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total  time  may  be  guessed  by  solving  a  suboptima 1  bang-bang  problem,  i.e., 
solving  the  single-switch  bang-bang  problem  for  the  two  most  important  states. 
Once  these  guesses  have  been  made,  we  are  ready  for  the  first  try  at  solving 
the  time-optimal  control  profile. 


IMPLEMENTATION 


The  optimal  control  is  the  solution  to  a  set  of  n  simultaneous  nonlinear 
equations.  The  problem  is  more  easily  solved  when  it  is  reformulated  as 
follows.  Define  k  as  the  number  of  steps  in  the  control  profile,  so  we  have 
for  the  state  A  at  step  k 


y,.  -  L  ...  ♦  Sfefr-V*  +  '“A1'*  .  PA>jUk, 

kA  y (k-l)A  oA  +  I  +  uo^ 


This  formulation  can  be  further  simplified  (in  the  manner  of  Ref.  6)  by  the 
following  identities: 


eigA  =  oA  +  i«A 


Plib.u. 


i/ 

and  =  e  (where  t^  is  the  optimum  length  of  time  to  impose  the  control 
value  u^) .  Then 


_eigA 

ykA  =  (y(k-l)A  +  akA)xk  "  akA 


If  the  initial  condition  is  y^^  and  our  final  condition  is  ymA,  where  m  is 


the  total  number  of  steps,  then  a  simple  calculation  shows  that 


ymA  =  tyOA  +  “lA^XlX2*  * -Xm^ 


+  ^a2A  *  °lA^x2x3‘”Xm^ 


+  #  *  +  [amA  •  a(m-l)A]xm 


With  further  s  .mpl  ification  w,  =  il  x. 

K  j=k  J 


I 


Pi 
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ymA 


ty0A  +  alA^wl 


’eigA  m"1  i r 
*  +  Z  {[a 

k 


n-1  ( 

A  ‘ 


(k+l)A  kAJ  k+1 


K 


-ei 


gA 


>  -  a  » 
mA 


(36) 


and  by  defining  c]A  -  yQA  ♦  «1A  and  c-A  -  aiA  -  «(i-1)A 


m 


-ei 


ymA 


=  z 


k-1 


ckAwk 


gA 


mA 


for  i  =  2  . . .  m,  we  have 
(37) 


For  each  state  this  gives  a  nonlinear  equation  for  the  final  state  as  a 


function  of  the  m  w^s.  We  must  solve  the  eauations  of  all  n  states  for  wk 


simultaneously.  To  do  this,  we  make  a  first  guess  at  the  optimal  profile  by 
specifying  initial  values  w^  for  k  =  1.2  ...  m  in  accordance  with  the  defini¬ 
tion  (Equation  35),  and  find  a  result  for  ymA,  which  can  then  be  compared  to 


the  target  result  y^A> 


By  this  comparison,  we  can  estimate  the  necessary  change  in  w^  by 
invoking  this  simple  linearization: 


t  . 


,y_mA 

'1 


ay, 


mA 


ymA  '  ymA  +  ':.Wl  6W1  +  3w„  u"2 


6  W„  + 


+  - -  6W 


3w  w"m 
m 


(38) 


To  solve  for  the  nartial  derivatives,  it  is  necessary  to  look  again  at  the 
form  of  ymA: 


m 


-eigA 

YmA  "  )<f1  ckAwk  '  a' 


mA 


(39) 


3ymA 


-ei 


gA 


for  then,  we  must  address  only  the  term  ckawk  .  But,  for  a  state 
A  whicn  has  a  complex  eigenvalue,  ckA  and  eigA  are  Complex  expressions  and 
may  be  written 


ckA  =  BkA  +  17kA 


e1gA  =  °A  =  lU)« 


(40) 


So  now  the  term  is 
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K.V? 


(ekA  +  lYkA)wk 


■ffA'luA 


Wk  "f  ®kAC0S  wAlnwk  +  YkA  sin  u)A1nwk 
+  t(YkAcos  uAlnwk  -6kAs1n  u>Alnwk)] 


It  is  most  efficient  to  analyze  the  real  and  imaginary  parts  of  this  term 
separately.  This  can  be  done  because,  for  the  similarity  transformation 
chosen,  each  state  of  a  complex  eigenvalue  has  a  complex  conjugate  state. 
Therefore,  we  define  the  real  part  and  imaginary  part  of  a  complex  state  as 
separate  states,  ignore  the  conjugate  state  and  thus  retain  the  same  number 
of  states.  Define  yk^  as  the  real  part  of  ykA  and  y£^  as  the  imaginary  part 

of  ykA.  Then 


**ymA  "°a”  ^ 

3*7  *  -Vk  [0kAcos  “fl,nwk  *  1'kAs(n  "A’n1 


-oA-l 


*  »Awk  ^kAcos  “Alnwk  •  6kAs1"  “Alnwkl 


s  'Vk  l[TkAcos  “A,nwk  -  BkAs,n  “Aln"k^ 


-oA-l 


Awk  l>kAsin  “Alnwk  *  BkAcos 


Of  course,  for  the  state  of  a  real  eigenvalue  the  equations  are  much  simpler 
and  there  need  be  no  auxiliary  states: 


~ei^AckAwk 


-eigA-i 


(44) 


Now  we  have  an  expression  for  each  first  partial  with  respect  to  wk  for 
each  unique  state  and  we  have 


[a]«w  =  y+  -  yn 


i'jJV 


I' 

Vf 


\t 
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where  4  * 


3^ml 

3Xnl 

3*«,i 

3w^ 

3wm 

Ki 

K i 

<1 

3W1 

3"m 

3»m3 

3^m3 

%3 

3Wj 

3W2 

3wm 

3y 

3w 


3y 


mn 


3W 


m 


(46) 


Using  a  linear  solver  we  can  solve  a  first-order  approximation  of  6w  and  use 

that  to  adjust  our  guess  at  w.  It  is  clear  from  the  definition  of  w^  that 

0  <  w.  <  w0  <  . . .  <  w  <1.  If  5w  causes  the  new  guess  to  violate  this 
12m 

identity,  then  a  first  order  approximation  is  not  good  enough.  For  a  com¬ 
plex  state,  the  expressions  for 


and 


are  easily  calculated  from  Equations  43  and  44.  For  a  real  eigenvalue  state, 
the  higher  order  derivatives  follow  from  45. 


A  second-order  approximation  may  be  used  as  follows, 
equation  is 


The  governing 


mk 


m 

+  z 


9Y_ 


m 


mA  Sw.  +  z  3  ymk  ,  .  s2 

wsr  ’  <-»  ^(5Wi) 


(47) 
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A  linear  solver  cannot  be  used  with  this  equation.  However,  using  the 
results  from  a  first-order  guess  at  6w,  as  detailed,  we  can  reformulate  the 
equation: 


y\  '  *mA  + 


where  $w*  is  the  result  of  a  first-order  solution  for  6w. .  Now  we  can  use  a 
linear  solver  to  find  <5w.  Fitting  this  solution  back  into  the  equation,  we 
can  reiterate  until  we  get  a  reasonable  estimate  for  5w.  Using  that,  we 
can  change  w,  and  iterate  using  the  first-order  (and  higher-order  if  desired) 
approximations  for  6w  until  an  exact  solution  is  found. 

EXAMPLE 

Consider  the  following  system 


0  0  1 

4  -6  -4 


with  control  -1  <  u  <  1.  This  represents  a  third-order  system  with  poles 
A  =  -2,  -l±i.  Let  us  define  a  boundary  value  problem  in  which  the  initial 
state,  xQ,  is  [1  0  0]T  and  the  final  state,  x^,  is  [0  0  0]T.  A  convenient 
transformation  is 


i-l  -l-i 


Note  that  the  column  vectors  of  P  corresponding  to  the  complex  conjugate 
states  are  themselves  complex  conjugates.  This  allows  us  to  ignore  one  of 
the  states  in  y-space,  because  the  corresponding  states  (yg  and  y^)  are 
complex  conjugates  for  all  time: 


I 
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Yj  =  -2y1  +  0.5u 

y2  =  (-l+i )y2  -  0 . 25 ( i+l )u 

y3  »  (-l-i )y3  +  0.25(i-l)u 


y0  =  [1  -t  i]1 


yf  =  [o  o  o]1 


(49) 


Ignore  y2;  do  the  bang-bang  problem,  define  u  =  1  and  select  the  number  of 
switchings  to  be  two,  since  that  is  one  less  than  the  order  of  the  system. 
Clearly,  the  only  sequence  of  controls  that  will  work  for  two  switchings  is 
ul=-l,  u2=l,  u3=-l.  From  this  and  the  definition  for  a,  it  follows  that 


‘11 


=  0.25,  a2j  =  -0.25,  cx-5-i  =  0.25,  a,,  =  i/4,  a„  =  -i/4,  and  =  i/4. 
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13 


‘23 


‘33 


Using  (8)  we  have 


y3l  •  (5/4)Wl2  -  (1/2)w22  +  (1/2)w32  -  1/4 


y33  =  ( 5/ 4 ) iWj 1+1  -  (i/2)w2i+l  +  (i/2)w31+1  -  t/4 


l+i 


l+i 


(50) 


Or,  separating  the  real  from  the  imaginary 


y33  =  "(5/4^wi  sin(ln  wj)  +  (1/2)w2  sin(ln  w2) 
-  (  1/2)v(3  sin  (In  w3) 


y33  =  (5/4)v/jCOS(ln  w^  -  (l/2)w2  cos(ln  w2) 


+  (l/2)w3  cos(ln  w3)  -  1/4 


(51) 


The  first-order  partial s  fall  out  directly 
9y33 


3W  =  -5/ 4[si n( In  Wj)  +  cos(ln  w^] 


ay33 


aw. 


5/4[cos(ln  -  sin(ln  w^] 


9y31 

=  5/2»i 


(52) 
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The  derivatives  for  the  other  w^s  are  similar 


We  are  now  ready  to  guess  at 
the  control  profile  and  begin  solving  for  it.  A  simple  switching  curve 
analysis  between  and  shows  that  the  total  time  for  the  problem  may  be 
around  1  s.  Using  the  definition  for  w,  we  can  guess  w^  =  0.4,  W2  =  0.6  and 


Using  these  values,  we  get  for  the  final  states: 
=  0.3722  and 


w3  a 


y31 


33  + 

and  y*3  .  0 


*33 


=  0.015, 

0.1207  where  the  final  states  are  y^  =  0,  y^  =  0 


Now,  we  can  use  Equation  47  to  find  a  correction  to  w.  We  have 


1.0000  - 

0.6000 

0.7000 

-0.0150 

A' 

0.2307 

0.1917 

-  0.2940 

so  that  [a]Sw  = 

-0.3722 

1.7526  - 

0.6806 

0.6431 

-0.1207 

Hence,  6w  =  [-1.2528  -7.2490  -4.451]  .  These  are  values  that  have  no 

physical  meaning,  so  we  must  go  to  a  higher  order  calculation.  We  can  now 

use  Equation  48,  where  <5w*  is  the  result  of  the  first-order  calculation. 

Equations  for  the  second-order  partial s  follow  from  Equation  53.  Now  we 

begin  a  cycle  of  iterations  on  <5w  until  we  converge  on  a  value  that  will 

satisfy  the  bounds  on  w.  In  this  case,  we  arbitrarily  chose  to  iterate  30 

times  to  arrive  at  5w  =  [-  0.3286  -  0.4819  -  0.0167]T  As  a  result,  w  = 

[0.0714  0.1181  0.6833]T  .  With  this  value  for  w,  the  final  states  are  now 

y^l  =  -  0.017,  y^^  =  0.1201  and  y|^  =  0.0206.  These  are  much  closer  to  the 

target  end  condition  than  the  first  guess.  We  are  now  close  enough  to  the 

desired  states  to  use  the  first-order  method  to  get  to  a  final  solution. 

1  1 

With  only  five  iterations  we  get  to  within  10  of  the  target  for  all  three 
states.  The  final  w  is  [0.0619  0.2766  0.7529]^,  which  mandates  a  control 
time  profile  of  t^  =  1.4963,  t^  =  1.0015  and  t^  =  0.2838.  This  time-optimal 
control  profile  is  shown  in  Fig.  10. 
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Figure  10.  Time-optimal  control  profile. 

The  phase  plots  for  x^  versus  (Fig.  11) and  x^  versus  x^  (Fig.  12) 
show  that  this  solution  brings  all  the  states  to  the  desired  condition 
simultaneously. 


Figure  11.  X.  versus  X. 
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V.  OPTICAL  RETARGETING  PERFORMANCE  ENHANCEMENTS  DUE  TO  TIME-OPTIMAL 

STEERING  FOR  TYPE  II  SYSTEMS 

INTRODUCTION 

In  this  section,  a  simple  type  II  control  loop  is  used  to  derive  general 
conclusions  about  the  retargeting  time  performance  enhancement  rendered  by 
time-optimal  control . 

MODELING 

For  this  analysis,  a  simple  lead  compensator  of  bandwidth  o)Q  and  lead 
ratio  a  on  a  pure  inertia  in  a  unity  gain  feedback  is  used.  (See  Fig.  13.) 

For  this  system  the  transfer  function  is: 

x  g)V^(s  +  u,0//^)  (54) 

U  S3  +  Wq/i  s2  +  cu2^  S  +  OJ3 

SYS,  the  code  used  in  this  study  to  find  time-optimal  switchings,  uses  a 
state-space  system  representation  x  =  Ax  +  bu,  where  x  is  the  state  vector. 

A  is  the  dynamics  matrix,  b  is  the  input  vector  and  u  is  a  scalar  command 
(Ref.  10).  We  will  address  only  the  single-input  single-output  problem. 

The  system  of  Fig.  13  can  be  put  in  the  following  canonical  time-domain  form 
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Figure  13.  Type  II  system  with  lead  compensation. 

where  x  is  the  element  of  the  state  vector  x  that  corresponds  to  osition. 

For  most  practical  cases,  however,  the  A  matrix  will  be  highly  ill-conditioned. 
Because  SYS  requires  a  well -conditioned  dynamics  matrix,  it  is  necessary  for 
us  to  scale  A. 

SCALING 


Time-scaling 


The  easiest  scaling  is  time-scaling.  If  we  change  the  problem  from 
time  t  to  a  normalized  time  t,  by  a  factor  y,  we  have 


dx  dx 
dx  '  Y  dt  ’ 


so 

^  =  yAx  +  ybu  (56) 

This  scaling  will  not  change  the  condition  number  of  the  matrix,  since  all 
the  elements  are  simply  multiplied  by  the  scale  factor  y,  but  it  can  make  the 
solution  of  the  time-optimal  problem  easier.  Because  SYS  weights  time  in 
exponential  functions  in  its  solution,  it  works  best  for  solutions  on  the 
order  of  t  =  1. 
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Magnitude-scaling 

The  only  type  of  scaling  that  will  improve  the  condition  number  of  A  is 
scaling  of  the  separate  states.  The  canonical  form  chosen  to  represent  the 
system  makes  this  scaling  easy.  Shown  in  Equation  57  is  a  time  and  magnitude 
scaled  system  representation,  where  6  and  \  are  magnitude  scale  factors  and  y 
is  the  time  scale  factor. 
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Now  taking  a  general  scaling  approach  in  which  8  = 
renders 


and  y  *  — , 


This  scaling  shows  that  the  system  response  is  not  a  function  of  bandwidth, 
but  only  of  the  lead  ratio  a.  Bandwidth  is  reciprocally  related  to  the  time 
scaling.  For  example,  a  simple  type  II  system  with  a  bandwidth  of  1  Hz  has 
the  exact  response  of  a  10  Hz  system  on  a  time  scale  compressed  by  a  factor 
of  10. 

SYSTEM  EIGENVALUES 

Before  examining  the  effects  of  a  time-optimal  solution  to  our  third-order 
system,  we  should  look  at  its  eigenvalues.  Their  value  is  a  function  of  a: 
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time-optimal  method  is,  for  the  most  part,  relatively  insensitive  to  this 
trend,  and,  hence,  the  time-optimal  advantage  over  the  classical  set-point 
change  reaches  a  lower  limit  at  a  =  9,  when  the  eigenvalues  are  triply 


redundant  at  u  . 

o 


TIME-OPTIMAL  SOLUTION 


The  time-optimal  solution  for  a  system  like  this,  in  which  the  control, 
u,  is  constrained  in  magnitude,  is  a  switching  between  the  maximum  and 
minimum  values  for  u  (Ref.  12).  For  a  system  of  real  eigenvalues,  the  number 
of  switchings  is  n-1,  where  n  is  the  order  of  the  system  (Ref.  13).  Even  for 
a  system  with  complex  eigenvalues,  my  experience  shows  that  small  displace¬ 
ments  from  zero  initial  conditions,  a  type  of  problem  consistent  with  beam 
steering,  also  require  only  n-1  switchings.  Therefore,  in  order  to  solve  the 
time-optimal  solution  for  such  a  problem,  we  assume  a  solution  in  which  u 
switches  between  its  maximum  and  minimum  value  (the  same  maximum  magnitude 
with  different  signs)  n-1  times.  The  solution  is  found  by  determining  the 
exact  time  lengths  for  each  leg  of  the  control  profile  that  bring  the  system 
from  the  initial  condition  to  a  target  ondition.  For  instance,  for  ct  =  10 


we  have 


-3.16228  1  0 


-3.16228 


0  0 


3.16228  u 


From  this  we  can  define  the  problem 


| u  |  <  $  x"Q  =  [0  0  0]  T  and  x+  =  [1  0.31623  0] 


where  xQ  is  a  zero  initial  condition  and  x  is  a  steady-state  end  condition 


that  will  hold  Xi  =  1.  The  magnitude  limit  of  u  is  described  by  <i>.  To  take 
advantage  of  the  time  optimal  technique,  u  must  be  larger  in  magnitude  than 


what  is  required  to  reach  x  using  a  classical  set-point  change.  For  instance. 


'  -V-  v-y  *■-  >V.  v  •; 


W 

i 

» 
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if  we  were  to  define  the  u-limit  as  *  =  4,  then  we  would  find  that  the  system 
will  move  much  more  quickly  switching  between  u  =  ±4  than  it  will  with  just 
inputing  u  =  1.  The  gain  in  retargeting  performance  by  using  time-optimal 
switching  for  this  problem  is  a  function  of  the  ratio  of  *  to  the  magnitude 
of  the  classical  u  input.  We  will  call  this  ratio  the  overtorque  ratio. 

This  functional  dependence  will  be  investigated  parametrically  against  a  in 
the  next  paragraph. 

TIME-OPTIMAL  RETARGETING  PERFORMANCE  AS  A  FUNCTION  OF  THE  0VERT0R0UE  RATIO 

The  results  of  time-optimal  simulations  will  be  examined  and  compared 
to  the  classical  set-point  change.  The  standard  for  comparison  will  be  the 
time  it  takes  to  get  the  system  from  xQ  to  x+  within  a  tolerance  of  5  percent 
(i.e.,  state  xx  must  be  within  5  percent  of  x+j). 

Three  cases  will  be  examined  in  detail:  a  =  4,  a  =  16  and  a  =  9.  In 
each  case,  the  time  to  final  state  was  determined  for  overtorque  ratios 
ranging  from  1.01  to  100.  Comparing  these  times  against  the  time  it  takes 
for  a  classical  set-point  change,  we  can  derive  effective  retargeting  band¬ 
width  (ERB)  ratios.  For  instance,  in  the  case  of  a  =  9,  an  overtorque  ratio 

of  2  results  in  a  time  of  3.05  time  units  from  x  to  x+  (time  units  are 

o 

normalized  on  a  bandwidth  of  uo  =  1).  The  classical  set-point  change  requires 
6.57  time  units.  Thus,  the  time-ODtimal  profile  enhances  the  retargeting 
performance  by  a  factor  of  2.15.  It  gives  the  system  the  retargeting  response 
of  a  system  with  bandwidth  ujq  =  2.15.  We  then  say  that  the  ERB  ratio  is  2.15. 

In  Table  1,  some  of  the  results  of  the  time-optimal  simulations  have 
been  tabulated.  A  number  of  things  can  be  seen  from  this  chart.  The  most 
obvious  conclusion  is  that  even  for  overtorque  ratios  close  to  1,  you  get  a 
considerable  reduction  in  retargeting  time.  Also,  it  can  be  seen  that  the 
time-optimal  performance  is  relatively  insensitive  to  variations  in  a, 
particularly  for  large  overtorque  rations.  Figure  14  shows  a  graph  of  the 
ERB  ratios  versus  the  overtorque  ratios. 


AFWl-TN-86-72 


TABLE  1.  Time-Optimal  Solutions  for  5  percent  settling  criterion. 


a  =  4 

o  =  16 

o  =  9 

Normalized 

Classical 

Set-point 
Change  Time 

7.36 

7.78 

6.57 

Overtorque 

Normalized 

ERB 

Normal ized 

ERB 

Normalized 

ERB 

Ratio 

Retargeting 

Ratio 

Retargeting 

Ratio 

Retargeting 

Ratio 

Time 

Time 

Time 

1.1 

3.88 

1.90 

7.98 

0.97 

5.59 

1.18 

2 

2.63 

2.80 

3.60 

2.16 

3.05 

2.15 

5 

1.82 

4.04 

2.11 

3.69 

1.94 

3.39 

10 

1.43 

5.15 

1.56 

4.99 

1.49 

4.41 

20 

1.13 

6.51 

1.20 

6.48 

1.16 

5.56 

50 

0.83 

8.87 

0.86 

9.05 

0.85 

7.73 

100 

0.66 

11.15 

0.68 

11.44 

0.68 

9.66 

1  10  100 


Overtorque  Ratio 

Figure  14.  ERB  Ratio  versus  overtorque  ratio  for 
5  percent  settling  criterion. 

The  real  benefit  of  time-optimal  control  is  not  seen  until  accuracy 
requirements  become  more  rigorous.  As  we  move  from  a  5  percent  settling 
criterion  to  a  perfect  settling  criterion,  the  time  needed  for  a  classical 
set-point  change  becomes  much  longer,  while  the  time-optimal  solution  does 
not  change  significantly.  Table  2  shows  the  tabulated  results  for  the  near 
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perfect  settling  case  in  which  the  settling  criterion  is  1/1000  percent. 
Figure  15  shows  the  ERB  ratio-overtorque  ratio  graph  for  the  perfect  case. 
Here  a  =  9  is  the  limiting  case  for  time-optimal  enhancement.  Note  that  the 
knee  of  the  curve  is  much  closer  to  1  than  it  is  for  the  5  percent  settling 
requirement.  This  demonstrates  that  as  settling  requirements  become  more 
rigorous,  the  time-optimal  control  renders  a  greater  savings  in  time  for 
lower  overtorque  ratios. 


TABLE  2.  Time-Optimal  Solutions  for  perfect  settling  criterion. 


a  =  4 


o=16 


o  =  9 


Normalized 
Classical 
Set-point 
Change  Time 


25.53 


34.18 


18.21 


Overtorque  Ratio 


Figure  15. 


ERB  Ratio  versus  overtorque  ratio  for  per¬ 
fect  settling  criterion. 
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Time 
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Retargeting 
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1.01 

10.08 
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2.41 

9.04 

2.01 
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1.1 

4.49 

5.69 

8.37 

4.08 
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3.01 

2 

2.85 

8.97 

3.74 

9.11 
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5.66 

5 

1.93 

13.26 
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15.65 
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8.97 

ft 

10 
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20 
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CONCLUSION 

Time-optimal  methods  for  retargeting  render  a  dramatic  improvement  in 
retargeting  performance.  This  has  been  demonstrated  using  a  simple  Type  II 
unity  gain  feedback  system  with  a  lead  compensator.  Even  for  the  limiting 
case,  time-optimal  techniques  provide  a  lucrative  improvement  in  perform¬ 
ance.  A  small  ratio  of  overtorque  results  in  a  greatly  increased  speed  of 
retargeting,  and  as  settling  requirements  become  more  rigorous,  time-optimal 
techniques  offer  even  more  of  an  advantage. 
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VI.  SOLUTION  OF  THE  TIME-OPTIMAL  RETARGETING  OF  A  9TH-ORDER  BSM 

MODEL 


MODELING 


Reference  14  describes  the  modeling  of  the  laboratory  setup.  A  large 
block  diagram  of  both  BSM  axes  was  produced  and  the  system  in  the  s-domain  was 
described.  This  model  was  taken  and  combined  into  a  single  block  for  a 
closed-loop  representation  of  a  single  axis.  The  transfer  function  for  this 
single  axis  closed  loop  is: 


K(s3  +  A0s2  +  Ais  +  A2, 


^  s9  +  BiS8  +  B2s^  +  B3S8  +  B4s5  +  Bss^  +  B8s3  +  B7S  +  BgS  +  B9 


where  x  is  the  output  angle  in  radians  and  u  is  the  angle  command  and  Table  3 
lists  the  system  coefficients: 


TABLE  3.  System  coefficients. 


Bx  =  1.037  X  105  B6  =  1.333  X  1026 


A0  =  4.037*  X  10 


B2  =  1.313  X  1010  B7  =  1.837  X  1029 


Ax  =  6.379  X  10c 


B3  =  4.710  X  1015  B8  =  7.328  X  1030 


A2  =  9.869  X  10J 


B„  =  5.313  X  1018  B9  =  1.086  X  1033 


Bs  =  3.458  X  10 


K  =  1.077  X  10* 
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We  can  represent  this  system  in  the  following  canonical  form: 
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(66) 


In  this  representation,  y  is  a  time-scale  factor  so  that  the  time  units  are 

in  terms  of  r  =  — ,  where  t  is  time  in  seconds,  and  t  is  the  unit  of  time  in 
Y 

which  this  state-space  form  is  fashioned.  Hence,  in  a  system  so  scaled,  a 
time  of  1  time  unit,  with  a  scale  factor  y  =  0.001,  .means  0.001  s. 


The  scale  factors  on  through  a8  can  be  used  to  condition  the  dynamics 
matrix  for  a  more  efficient  solution  to  the  time-optimal  problem.  By  simply 
converting  from  state-space  back  to  the  s-domain  transfer  function,  it  can 
be  shown  that  neither  scale  factor  changes  the  characteristics  of  the  system 
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REDUCTION  OF  ORDER 

Large  order  systems  do  not  converge  well  to  a  solution  for  the  time- 
optimal  boundary-value  problem  unless  you  know  to  a  great  degree  of  accuracy 
what  the  time-optimal  control  profile  is  already.  This  is  true  because,  for 
large-order  systems,  the  canonical  form  for  state-space  used  here  is  sparse. 
Also  sparse  is  the  matrix  which  determines  the  differential  rate  of  states 
with  respect  to  control  leg  times.  The  result  is  that  for  large-order  prob¬ 
lems,  the  SYS  algorithm  is  unable  to  make  the  large  corrections  that  allow 
for  any  uncertainty  of  the  control  profile  solution.  The  remedy  is  to  reduce 
the  order  of  the  system  to  a  more  forgiving  space  (2nc^  or  3rc*  order)  and  to 
build  back  up  to  the  original  size  on  the  basis  of  the  answers  determined 
at  lower  orders. 

The  order  of  the  system  is  reduced  by  determining  the  eigenvalues  and 
selecting  the  dominating  ones.  A  discussion  of  how  this  was  done  for  the 
9th-order  BSM  model  follows. 

Begin  by  finding  the  poles  and  zeros  of  the  system,  which  follow  (nor¬ 
malized  in  seconds). 

TABLE  4.  System  poles  and  zeros. 

Poles  Zeros 

Ps  =  -3000  ±  i95394  Z2  =  -20106  ±  il5079 

P5  =  -29999  Zi  =  -153.22 

P„  =  -2520  ±  i  5757 
P3  =  -6191 

P2  =  -243' 

Pi  =  -18.26  ±  i75. 79 
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Now  choose  the  dominant  poles  to  build  the  lowest-order  system.  Clearly  the 
pole  pair  Pi  is  the  dominant  pole  pair  since  it  is  closest  to  the  origin. 

Then  take  Pi  and  Zi  to  fashion  a  transfer  function  that  has  similar  charac¬ 
teristics  to  the  9th-order  model.  Since  the  gain  on  the  full-order  model  is 
nearly  one,  adjust  K  for  all  cases  (including  the  9th-order  model)  to  be  one. 
For  the  second-order  approximation,  we  have: 


x  =  39.67(s  +  153.22) 

u  s2  +  36.5139s  +  6077.7 


[67) 


-36.5139  0 

. 

.1 

39.67 

_-6077.8 

X 

*T 

6077.8 
_  — 

(68) 


Scaling  in  magnitude: 


x  = 


[-36. 

L60- 


5139 

778 


100 

0 


x  + 


[39. 

I  60. 


.67 

778 


(69) 


Seal ing  in  time  [y  =  .01) : 


x  = 


-.3652 

1 

w  X 

.3967 

.  6078 

0 

X  + 

_l607L 

(70) 


A  scale  factor  y  =  0.01  makes  this  problem  easier  to  handle.  Hence,  answers 
will  be  expressed  in  l/100ths  of  seconds.  For  a  control  value  | u '  =  0.01, 
and  a  target  of  xi  =  0.001,  the  time  ODtimal  control  profile  is 


ti  =  0.449 
t2  =  0.350 


u  =  0.01 

u  =  -0.01 


(71) 


rd 


This  answer  can  be  used  as  a  guess  for  a  3  -order  system  with  pole  P2  coni- 
bined  with  Px.  The  3  -order  solution  is  then  used  to  guess  at  the  solution 
for  the  5^-order  model  (adding  pole  pair  Pi,  and  zero  pair  Z2).  Adding 
order  by  order  and  using  the  previous  solution  as  a  guess  allows  the  9^-order 
model  to  be  built  up. 
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SOLUTION 


For  the  9^-order  model  a  problem  is  prescribed  to  time-optimally  move 
a  BSM  on  one  axis  from  an  angular  deflection  of  0  to  one  of  1  mrad.  This  is 
the  same  as  moving  Xi  in  the  model  from  0  to  0.001.  To  get  a  true  solution 
requires  us  to  find  a  steady-state  x  for  x2  =  0.001.  This  steady  state  is 
used  as  the  end  condition  for  the  time-optimal  boundary-value  problem,  and, 
of  course,  the  6  vector  for  the  initial  condition.  All  that  remains  is 
specifying  the  control  values,  ju|  =  0.01,  0.005,  and  0.002,  which  correspond 
to  overtorque  ratios  of  10,  5  and  2.  The  solutions  (in  l/100ths  of  seconds) 
follow: 

TABLE  5.  Time-optimal  solutions  for  the  9^-order  problem. 


= 

0.4503 

| u |  =  0.005  t1 

= 

0.6739 

| u |  =  0.002  tx 

2 

1.2275 

t2 

= 

0.3749 

t2 

= 

0.4688 

^2 

= 

0.5427 

^  3 

= 

0.0391 

ta 

= 

0.0433 

^3 

= 

0.0590 

ti. 

= 

0.0210 

= 

0.0182 

t„ 

= 

0.0104 

^5 

= 

0.0242 

^5 

= 

0.0262 

^5 

= 

0.0333 

^6 

= 

0.0083 

= 

0.0064 

= 

0.0029 

1-7 

= 

0.0020 

T7 

= 

0.0015 

^7 

= 

0.0012 

te 

= 

0.0012 

tfj 

= 

0.0011 

^8 

= 

0.0011 

t9 

= 

0.0011 

t9 

= 

0.0009 

t9 

= 

0.0003 

Total 

retarget 

time  0.9222  1.2404  1.8787 

DISCUSSION 

Now  the  solutions  themselves  raise  some  interesting  issues.  The  first 
is  that,  once  again,  time-optimal  techniques  dramatically  improve  the 
retargeting  performance  of  a  BSM.  Using  a  classical  set-point  change  for 


this  boundary-value  problem  requires  17  hundredths  of.  a  second  (to  settle 
within  50  yrad  of  the  end  state).  Overdrive  ratios  of  10,  5,  and  2  yield 
shortened  retargeting  times  by  factors  of  18,  14,  and  9,  respectively. 

The  time-optimal  profiles  offer  some  interesting  conclusions.  Figure 
16  shows  the  progression  of  time-optimal  solutions  for  |u|  =  0.01  from  the 
2nt*-order  model  through  the  full-order  model.  The  waveform  of  the  final 
solution  is  dominated  by  the  control  legs  due  to  the  lower-order  solutions 
Table  5  shows  that  for  all  values  of  |u|,  the  major  differences  in  the  final 
solutions  lie  with  the  first  legs,  which  correspond  to  the  dominant  eigen¬ 
values.  In  fact,  the  higher-order  control  legs  due  to  the  larger  eigenvalues 
are  roughly  inverse  functions  of  the  eigenvalues  and  are  relatively  insensi¬ 
tive  to  differences  in  |u|.  This  would  lead  one  to  believe  that  low-orde> 
models,  that  account  for  the  dominant  eigenvalues,  are  sufficient  'n  yi.’’g 
the  dramatic  improvements  in  retargeting  that  time-optimal  methods  offe- 


2ND-ORDER  SOLUTION 

3RD-ORDER  SOLUTION 

5TH -ORDER  SOLUTION 

7TH -ORDER  SOLUTION 

EXACT  SOLUTION 


Figure  16.  Progression  of  time-optimal  solutions 
for  jui  =  0.01 . 


PERFORMANCE  OF  LOW-ORDER  APPROXIMATIONS 


Clearly,  for  a  boundary-value  problem  with  a  zero  initial  condition  and 
small  displacement  to  the  end  condition,  an  exact  solution  is  nearly  guaran¬ 
teed  when  assuming  a  number  of  control  legs  equal  to  the  order  of  the  system 
(with  the  proviso  that  the  end  condition  is  physically  attainable).  This 
fact,  coupled  with  the  results  already  detailed  in  this  section,  points 
to  a  one-to-one  correspondence  between  the  control  legs  of  the  solutions  and 
the  system  eigenvalues.  It  is  as  if  each  leg  accounts  for  a  single  eigenvalue. 
For  this  reason,  one  can  surmise  that  even  a  complicated  9  -order  system  can 
be  retargeted  with  performance  that  is  nearly  optimal  by  accounting  only  for 
the  dominant  eigenvalues.  In  this  case,  the  pole  pair  Pi  is  clearly  the 
dominant  eigenvalue  for  the  system  as  the  closest  eigenvalue  has  a  time  con- 

n  j 

stant  that  differs  by  a  factor  of  100.  The  solution  for  the  2  -order  model 
should  work  reasonably  well  for  the  full -order  model.  Table  17  shows  that 
this  is  in  fact  the  case. 

TABLE  6.  Reduced-order  solutions  for  the  9^-order  problem. 


Model 

i 

_j 

_ul 

2nd 

order 

0. 

.01 

0. 

,005 

yt  r\ 

0. 

.002 

3  ' 

order 

0. 

.01 

0. 

.005 

5th 

order3 

0. 

0. 

,002 

.01 

0. 

.005 

7  th 

order3 

0. 

0. 

.002 

.01 

0. 

.005 

gth 

order3 

0. 

0. 

,002 

.01 

0. 

.005 

0, 

.002 

Classical 

set 

-point 

0 

.n01 

xi  at  end 
of  control 
(target  =  0.00100) 

0.0012723 

0.0011486 

0.0010743 

0.0010427 

0.0010187 

0.001003 

0.0010096 

0.0010048 

0.0010017 

0.001000 

0.001000 

0.001000 

0.001000 

0.001000 

0.001000 


Time  of 

optimal  control 

0.799 
1.119 
1.752 
0.861 
1.183 
1.829 
0.888  ’ 
1.209 
1.850 
0.920 
1.256 
1.879 
0.922 
1.240 
1.878 


Time  required  to 
settle  to  within 
50  yrad  of  0.001 

0.871 

1.171 

1.778 

0.859 

1.168 

1.778 

0.862 

1.168 

1.778 

0.861 

1.168 

1.778 

0.861 

1.168 

1.777 

-16.6 


ain  higher-order  problems,  Xiactually  settles  long  before  many  of  the  other 
states. 
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It  can  be  seen  here  that  even  the  2ncJ-order  solution,  if  it  is  followed  by  a 
steady-state  input  of  u  =  0.001,  can  achieve  the  desired  end  conditions  at 
nearly  the  same  time  as  the  exact  solution.  Shown  in  Fig.  17  are  the  control 
profiles  and  time-responses  of  both  the  2nc*order  and  the  exact  solution  for 
I u !  =  o.oi. 
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(b)  Exact  solution. 

Figure  17.  Control  profiles  and  time  responses. 
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CONCLUSION 


Time-optimal  techniques  offer  a  dramatic  improvement  in  retargeting 
times  for  BSMs.  A  bang-bang  time-optimal  solution  does  this  by  accounting 
for  each  eigenvalue  of  a  system  and  suppressing  its  resonances.  A  large- 
order  system  may  be  solved  by  starting  from  the  most  dominant  eigenvalues 
and  building  a  smaller  order  system.  As  more  and  more  eigenvalues  are 
added  in,  time-optimal  solutions  of  the  smaller  systems  are  used  to  guess 
at  the  larger-order  systems  until  an  exact  answer  for  the  original  system 
is  found.  However,  the  time-optimal  solution  can  be  approximated  success¬ 
fully  with  a  lower-order  system,  if  the  lower-order  system  accounts  for  all 
of  the  critical  eigenvalues. 
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